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[57] ABSTRACT 

A method and apparatus for sequencing views retrieved 
from a spherical still image rile provide the viewer the 
perception of video performance with low bandwidth trans- 
mission. The method incorporates digital transmission and 
automatic sequencing of the playback of the view. The 
apparatus provides video-motion rate images via low band- 
width digital transmissions or small data files from a still 
image taken of an inanimate environment The resulting 
method and apparatus allows the viewer to experience a 
video display of any environment (far example, real estate 
locations, malls, museums, and hotels) and view a * Video" 
tour of the location through a low bandwidth transmission. 

7 Claims, 4 Drawing Sheets 
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METHOD AND APPARATUS FOR 
PROVIDING PERCEIVED VIDEO VIEWING 
EXPERIENCES USING STILL IMAGES 

RELATED APPLICATIONS 
This application is a continuation-in-part of U.S. appli- 
cation Sex. No. 08/516,629, filed Aug. 18, 1995, entitled 
Method and Apparatus for the Interactive Display of Any 
Portion of a Spherical Image", still pending of Laban Phelps 
Jackson, Alexis S. Pecoraro, Peter Hansen. Martin L. Bauer, 
and H. Lee Martin, which is a continuation-in-part of Ser. 
No. 08/494.599, filed Jun. 23, 1995, now abandon, entitled 
"Method and Apparatus for Simultaneous Capture of a 
Spherical Image** of Danny A. McCall and H. Lee Martin, 
which is a continuation-in-part of a U.S. application Ser. No. 
08/386,912 filed Feb. 8. 1995, now abandon, which is a 
continuation of U.S. application Ser. No. 08/339,663 filed 
Nov. 11, 1994, now abandon, which is a continuation of U.S. 
application Ser. No. 08/189,585 filed Jan. 31. 1994(now 
U.S. PaL No. 5384,588), which is a continuation-in-part of 
U.S. application Ser, No. 07/699366 filed May 13. 1991 
(now U.S. Pat No. 5.185.667). This application is also a 
continuation-in-part of U.S. application Ser. No. 08/373,446 
filed Jan. 17. 1995, pending, which is a continuation-in-part 
of U.S. apphcation Ser. No. 08/189 ,585 filed Jan. 31, 1994 
(now U.S. Pat. No. 5384,588). 

BACKGROUND OF THE INVENTION 

1. Technical Field 

Hie invention relates to an apparatus and method for 
utilizing still spherical or high resolution flat images to 
provide a moving tour through the image that creates the 
perception of the part of the user of experiencing a video 
presentation. The invention allows a multiplicity of prede- 
termined paths to be followed faithfully in such a way as to 
be replicable. In this invention, the objective is the control 
of the view shown to the user instead of manipulation of an 
object, the data is the angle of view, and hardware is a 
computer monitor. The invention solves a key problem with 
the transmission of sequenced images (ie. video) over small 
bandwidth connections by using a sequence of move com- 
mands on the still spherical or high-resolution fiat image to 
imitate a video of the environment or object Additionally, 
the subject invention allows the user to take control of the 
viewing direction at any time and look in any desired 
direction, giving a new dimension to interactive television, 
namely, personalized control of what is viewed. 

2. Related Art 

It is known how to pan, tilt rotate, and magnify a live 
video image via an affine transformation algorithm as docu- 
mented patented in U.S. Pat No. 5.185.667, assigned to the 
same assignee as this disclosure. This method captures a live 
video or still photographic image, removes the distortion 
associated with the lens optics, and reconstructs a portion of 
the image that is of interest based on operator requests for 
pan, tilt rotation, and magnification. One application of the 
dewarping technique disclosed by this patent is the dewarp- 
ing of hemispherical images. The capturing and dewarping 
of hemispherical images is disclosed in greater detail in U.S. 
Pat No. 5,185,667, expressly incorporated herein by refer- 
ence. The ability to simultaneously distribute these images 
and allow multiple users to independently view the image in 
any desired direction is documented and patented in U.S. 
Pat No. 5384,588. assigned to the same assignee as this 
disclosure and, hereby, incorporated by reference. 

Other parent applications, which may be of reference for 
various parts of the invention described in greater detail 
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below, include the following: U.S. application Ser. No. 
08/516,629, filed Aug. 15, 1995, entitled "Method and 
Apparatus for the Interactive Display of Any Portion of a 
Spherical Image" of Laban Phelps Jackson, Alexis S. 

5 Pecoraro. Peter Hansen, Martin L. Bauer, and H. Lee Martin, 
which is a continuation-in-part of Ser. No. 08/494399, filed 
Jun. 23. 1995. entitled "Method and Apparatus for Simul- 
taneous Capture of a Spherical Image** of Danny A. McCall 
and H. Lee Martin, which is a continuation-in-part of a U.S. 
application Ser. No. 08/386312 filed Feb. 8, 1995, which is 
a continuation of U.S. application Ser. No. 08/339,663 filed 
Nov. 11, 1994. which is a continuation of U.S. application 
Ser. No. 08/189385 filed Jan. 31, 1994 (now U.S. Pat. No. 
5384388), which is a continuation-in-part of VS. applica- 
tion Ser. No. 07/699366 filed May 13. 1991 (now U.S. Pat 

13 No. 5,185,667) . This application is also a continuation-in- 
part of U.S. application Ser. No. 08/373.446 filed Jan. 17, 
1995, which is a continuation-in-part of U.S. application Ser. 
No. 08/189,585 filed Jan. 31, 1994 (now U.S. Pat No. 
5384388). 

20 Video images, as described in each of the above- 
referenced patents, require approximately 30 frames per 
second to appear as a real-time video image. Unfortunately, 
a problem with real-time video rates is the great amount of 
memory and processing speed required to display these 

23 images. Alternatively, if a user wanted to download a 
real-time video clip from a distant source via a modem (for 
example, a bulletin board system or a global network of 
computers), the user must have a high speed modem with a 
wide bandwidth (for example, a minimum 128 kps ISDN 

3Q line or a Tl or a T3) with a relatively powerful computer to 
download these Images and display them in real-time. As 
most users do not have high speed modems or relatively 
power computers, not to mention, a bandwidth capable of 
handling real-time videos, most users are at a disadvantage. 
Even compressing the video data fails to achieve good 

35 results. 

Other techniques of transmitting images include transmit- 
ting a single still image after single still image. This saves 
bandwidth but is no more exciting than watching a slide 
presentation with someone else operating the slide projector. 

40 This is because the viewer is presented with a bland, static, 
two-dimensional image. 

In a different field of endeavor, a technique is known in 
the robotics industry which is know as *teach/playback T \ 
The 'leaching" mode of a "teach/playback" technique 

45 relates to the recording of a series of movements of a user 
controlled device. Later, in the playback" mode, the 
recorded movements are played back for subsequent pur- 
poses. An instance of the "teach/playback" technique is in 
the automotive industry where a robot operator 'teaches" a 

50 robotic system how to perform a complex series of tasks 
involving various manipulations. For example, the robotic 
system may be taught how to weld portions of a car's body 
panels to a car's frame. In the playback mode, the robotic 
system repeatedly follows its memorized commands and 

55 welds body panels to frames as per its instructions. The 
*teach/playback" technique of programming manipulative 
systems has its drawbacks. For instance, systems operating 
under a "teach/playback" technique are inherently limited to 
perform only the recorded instructions. Variation in the 
playback of a recorded set of instructions is unheard of. The 

60 only way to change the operations of the control device is to 
reprogram its instruction set or here, *Teteach w the system. 

OBJECTS OF THE INVENTION 
Accordingly, it is an object of the present invention to 
65 provide a user experience that appears to be video, but uses 
spherical still images with sequencing instructions as its 
command file. 
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It is another object of the present invention to provide this embodiment, the ASCII command file is generated by the 

imaging experience using digital files that can be bundled recording of an operator's viewing of a displayed image. In 

with other files to present a multimedia experience. an alternate embodiment, the operator directly feeds com- 

It is a further object of the present invention to provide a mands into an text file which later controls the viewing of 

continuation viewing experience by decompressing the next s the still image. 

image to be viewed (and audio files to be beard) while The disclosed system includes a means for receiving a 

displaying a current image and playing a current audio file. digital file that is composed of two hemispherical fisheye 

It is another object of the invention to allow the user to images or a single high resolution digitized image, receiving 

interrupt the "video" sequence at any time and take control 4 second command file consisting of the sequence of view- 

of the viewing direction and magnification. 10 in « directions used to animate the still image to provide the 

It is a further object of the invention to allow the data V™f° a ° f ^ orm5 »* a P 01 * 0 * of 

required for this viewing experience to reside in a remote based upon command file operations or user commands, and 

location and be dowrioadedto one or many users simulta- ? roducu « a co °*™ «*^t images that are 

neously (or sequentially, or as requested) via telecommuni- „ ,n ^ P^P^/« jewing. The collection of oom- 

cation networks including at leasUocal area networks, wide 15 ^ used to control what a view mmally ^ are stored 

area networks. globaUrea networks, satellite networks and « » conimand ^quenong dala file. A user can eat from the 

other related networks by means of satellite downloading. ^ ^ h"" 'ZTf 

modem downloading, broadcast downloading or other 'equencmg ^ and. when finished, return control to the 

equivalent downloading means. „ command ^"^B daU file. 

It is another object of the invention to provide the ability . ™ c lcsumn * ^ P ro ^ s 8 ° f a «<«eo 

J*, j * * *v • / image sequence even though the source data may only be 

to magn^. pan. bit. zoom, and rotate the .mage vu a simple ^^ of , photograph . „ on/preferred 

embodiment, the transmitted image is produced by a com- 
It is a further object of the invention to provide the ability bination of two fisheye photographic images which provides 
of panning, tilting, zooming, and rotating with simple inputs 75 a spherical data set from which to extract the sequenced 
made by an unskilled user through standard input means field-of-view. This image data is augmented with a corn- 
including joysticks, keyboard, mice, touchpads, or equiva- msnd file that determines the sequence of images to be 
lent means. displayed from the image file in such a way as to provide the 
It is another object of the present invention to simulta- appearance of a video image to the output display. These 
neously display the multimedia experience for a plurality of 30 incoming data files, image and command, are captured into 
users through common downloaded or broadcast an electronic memory buffer and the image file is trans- 
information, allowing all to be sequenced at the same time formed to the display as directed by the command file or by 
or to be user controlled in different directions in any of an the user if the command file is interrupted. The image 
infinite number of directions as selected by the users. transformation is performed computationally by a micro- 
These and other objects of the present invention will 35 processor common in many personal computer systems, 
become apparent upon consideration of the drawings and Additionally, related computational devices may be used 
accompanying description. including co-processors, dedicated computers, ASICs, and 

equivalents thereof. The display of the sequenced image is 

SUMMARY OF THE INVENTION accomplished in a window on a common computer monitor. 

The invention relates to constructing a viewable image, 40 ^ onaU _£ * c *W*7 include 
only a portion of which is displayed at a given time in an s * ° VCThca ? ^^^ s ' fJroj . ccUon SCT< ?\ 
enveloping viewing environment Upon execution of a pre- P^ s *°£ ^vlaents thereof. The experience providedby 
determined instruction set, a viewer is presented with a mctb ^ apparatus can be augmented with the 
moving tour of a heimspherical/spherical image. At any 43 inclusion of audio to allow the resulting output on a -multi- 
tone, the viewer inay take control of the tour of the displayed ™J P™>™* ™»P"«* to be similar to that of standard 
image and explore the image on his own. By using a high television. 

resolution static image, the display of a high quality video A portion of the captured image containing a region-of- 

image at real-time video rates (30 frames per second) is interest is transformed into a perspective correct image by 

achieved. The result is obtained with only a fraction of the 50 ima S c processing computer means and sequenced by the 

data needed to accomplish the same result as compared to command file or by direct intervention of the user. The 

compressed video data. Where a video sequence for 10 ima 8 c processing computer provides direct mapping of the 

seconds of operation would require 300 separate images, the i™ 4 ^ region-of -interest into a corrected image using an 

subject invention requires only one image with a limited orthogonal set of transformation algorithms. The viewing 

number of sequencing commands to drive the presentation. « orientation is designated by a command signal generated by 

The oninidirectional viewing system produces the equiva- **** a human °^ AXor <* com P uter ^ UCDCcd ^ 

lent of pan, tilt; and zoom within a spherical digitized BRIEF DESCRIPTION OF THE DRAWINGS 

photograph or sequence of digital images (digital video), or „ , ^ ti 

siib^ettoereof, with no ii^grmu. This invention can also . 110 1 s i ! J ows a ^f™*<; Wock digram f the present 

pan, tilt and magnify portions of a high resolution image, <so lDVCimoD illustrating the major components thereof, 

only revealing those portions of the image presently of FIG. 2 shows the user interface for the user control of the 

interest to the user. viewing direction and magnification. 

The small data capacity required for this form of presen- FKj. 3 shows the command file for a simple sequence, 

tation results from the fundamental data source comprising FIG. 4 shows a typical sequence as it might be viewed 

a still image that is rime sequenced through its motion by 65 from the command file of FIG. 3. 

simple ASCII text commands that are automatically inter- FIG. 5 shows the sequence of FIGS. 3 and 4 in a 

preted in the running program. In one preferred hemispherical image. 
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FIG. 6 shows the projection of a view rectangle on a downloading image data files 6 and command sequencing 

three-dimensional image as projected from a viewer's loca- data files 7 include satellite downloading, modem down- 

tion. loading (including from bulletin boards and the Internet). 

and broadcast downloading. 

DETAILED DESCRIPTION 5 Alternatively, the files may be available through client/ 

The principles of the present invention can be understood f^T ^i^If P"*^ ,«»" * a 

. r*^ f rJZ « JF™ " , , , MWU location with resulting display at the client's location. In mis 

reference to FIG. 1. Fisheye or wide angle lens 1 captures rcganL ^ mcs 6 Jfr havc to ^ loadcd to 

a ^f 1 ? 01 ^ OT angle image. Lens 1 focuses the a user » s computer but rather onto a central server. In this 
captured image onto camera 2. Camera 2 is more fully regard, the user's computer may access the server through 
disclosed in co-pending U.S. Set No. 08/494,599, entitled any of the communication networks described above. 
"Method and Apparatus for Simultaneous Capture of a when both image data file 6 and command sequencing 
Spherical Image expressly incorporated herein by refer. data file 7 are available for use by computer 10. computer 10 
^Tf* 5 ^ 10 ^ ^ °5°vf ? ^f* e Perf^ms the sequencing operations as detailed infce coin- 
group comprising of at least still cameras with loaded film ^ sequencing data rile 7 on the image as stored in the 
or digital ^ image data file 6. When the image data file contains a 
film or distal image capture, the KO^™ digital ^mage hemispherical image (or any irnageOiat contains distortions 
entire system, video, linear scanning CID. CCD. or CMOS ^ to lens optics), the computer 10 implements a math- 
APS camera arrays and other equivalent image capture ematical transform to remove the optical distortion from the 
devices The two general types of available cameras are distorted image. The mathematical transform is fully 
shown by camera 2a ^ camera 2b. Qunera 2a is a 20 described in U.S. Pat. No. 5,185.667. expressly incorporated 
chemical camera into which film is loaded, exposed, and herem by reference. The use of the mathematical transform 
later ^oped. Ounera 2* is a digital ^^V^f^ corrects the distortion and perspective as desired by the 
more ^ J^sed «»U& teNo. 08/494399, filed Jun. command sequencing data mel.T^resulting planar image 
23, 1995. referenced above. TVirxxl 4 supports the camera 2, is displayed on monitor 11 providing an experience compa- 
nding a stable imagccarrture platform. When two back- 25 ra hle to video even though the data is provided from a static 
£t*? T^/JS dls ^ 1 sc ? in f^^f image, me user may assume control of the displayed image 
Ui^Ser. No. 08/494,599 , ref«nced ar^ve) tnr^ 4 holds to more fully explore the image file 6. TTiTuser inr^f a 
the two cameras in a back-tc-back relationship. The pair of command from one of the various command input devices of 
cameras capture the environment in two matching hemi- mou$c U keyboard 13, or other computer input device, to 
spheres The resulting exposed film is then processed and mtemfflt me execution of the command sequencing data file 
mgitedviascaimmgSmtoadigi^ 7. Samples of a command indicating the user wants to view 
environment. the image on his own may include mouse clicks, depression 

Preferably, the resolution of an image file is at least 2000 of the space bar, movement of the mouse or trackball or 

pixels by 2000 pixels. While resolutions of 512x512 have ^ equivalents thereof. The user is now able to look in any 

been developed for slower computers and transmission direction in the image file, providing an interactive viewing 

mediums, large image sizes are preferred. A standard com- experience. Alternatively, the output of the computer 10 may 

pressed image file of 128 kb may be decompressed in be recorded on videotape, hard disk. CD-ROM, RAM, 

memory to 2 megs decompressed. However, while larger file ROM, and equivalents thereof for storage and later viewing, 

sizes are preferred as they offer greater resolution and color ^ HG. 2 shows a user interface 15 as experienced by the 

depth, larger files take a longer time to download and user once a user has indicated that he wants to view the 

process. image on his own. The interface 15 may be displayed over 

Command sequencing data file 7 stores commands which the entire viewing screen of the monitor 11 in a translucent 

control the view as displayed on a user's monitor. Command form. Alternatively, the interface 15 may be significantly 

sequencing data file 7 also stores commands which retrieve 45 smaller and translucent or opaque. As with windowing 

new image files and play multimedia (for example, video operating environments, the interface 15 may be moved out 

clips) and sound files. The combination of these three sets of of the way by means of standard moving techniques 

commands enables a complete, multimedia experience. The (including grabbing a displayed handel of the image or 

command sequenece data file may be a file stored in the through a series of mouse clicks of keystrokes). 

RAM or ROM of a computational device, a hard drive, a 50 The position of cursor 14 is controlled by the viewer* s 

tape, a CD-ROM. hardwired into an ASIC, and equivalents movement of mouse 12 (or trackball touch pad. or other 

thereof. Additionally, the image data file may be a file stored pointing device or by keyboard entry). As cursor 14 moves 

in the RAM or ROM of a computational- device, a hard around the interface 15, cursor 14 changes shape as deter- 

drive. a tape, a CD-ROM, hardwired into an ASIC, and mined by its position relative to the center of interface 15. 

equivalents thereof. 55 When the cursor 14 is in or outside any of the octants 

Referring to FIG. 1, the image data file 6 and command ISa-lSK the cursor assumes the shape of a hand as indi- 
sequencing data file 7 are then distributed to a user's cated by hand 14. As the cursor moves around, the orien- 
personal computer 10. Preferably, computer 10 is at least an tation of the hand icon may change so that it is always 
Intel 4361/66 or equivalent with 8 megabytes of RAM and pointing away from the center of interface 15 as represented 
running Microsoft's Windows 95. Improved response times 60 by the hands in each of octants ISa-lSh. Equivalent point- 
are achieved with upgrades to the hardware. For example, ing cursors may be used including arrows, triangles, bars, 
using a Pentium™ class computer would improve response moving Icons, and equivalents thereof. When the cursor is 
times. The distribution means includes distribution by inside regions 16a or 16b centered in interface 15. the 
CD-ROM S or over a communications network 9. Cornmu- cursor's Iconic representation changes to that of magnifying 
nications network includes at least local area networks, wide 65 glass 17. 

area networks, global area networks using twisted pair or When the mouse's control button is depressed, the image 

ISDN lines and satellite networks. The different ways of direction shifts in the direction pointed to by the hand and at 
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a rate of speed associated with the hand's distance from the 
center of the display. Id the center of the display, the hand 
icon turns into a magnifying glass 17, allowing zoom in 
(when the cursor is located in the above center region 16a of 
interface 15) and zoom out (when the cursor is located in the 
below center region 16b of interface 15) allowing the user to 
control the magnification ox scaling features of the current 
view. Equivalent zooming cursors may be used including 
arrows, triangles, bars, moving icons, and equivalents 
thereof. Under user control, the system provides the expe- 
rience of pointing a virtual video camera in the environment 
stored in the image data file 6 in any desired direction. 

FIG. 3 shows the command data file 7 for a simple 
sequence. A starting set of implemented commands includes 
START. MOVE. ZOOM. PAUSE, LAUNCH, and END, 
With these simple commands, a tour through the still image 
data set can be create and a compelling sequence generated 
The fundamental commands and a brief description of their 
purpose follows: 

START: Starts the sequence from a store pan, tilt, and 
magnification. 

MOVE: Moves the image to a new Location in a desig- 
nated time. 

ZOOM: Magnifies the image to a new zoom in a desig- 
nated time. 

PAUSE: Waits a specified length of time before continu- 
ing. 

LAUNCH: Launches a new file, cither a sound, new 
image or other data form (text window, video, other) to 
continue the sequence. 
END: Ends the execution of commands in the command 

sequencing data file 7. 
In an alternate embodiment, other command sequencing 
data files be launched from inside other command sequenc- 
ing files. Also, a jump feature to jump from one portion to 
another may be launched from inside another command 
sequencing file. This can be implemented in an editor 
environment. 

The command file is created by a development software 
tool which may be similar to the interface as described above 
in relation to FIG. 2 but with additional developer tools. 
These additional tools may include start recording function, 
stop recording functions, resume recording functions, 
launch a new file, link a new image file to a portion of the 
displayed images. To create a command sequence data file 7. 
the developer initiates a recording function, calls up a 
desired image data file 6. moves through the image data file 
and pauses or stops the recording function. The system 
stores the commands as input by the developer as the 
command sequence data file 7. If desired, the command 
sequence data file 7 can be edited with simple text editing 
tods. Command files can be developed from a series of 
commands that are similar in intent, but different in name 
from the ones listed herein. 

The command sequence shown in FIG. 3 shows the 
commands recorded or input by a developer. When 
executed, these commands will produce a visual and audio 
tour of a screen. In this example, the file LOBBY.BUB 
relates to an image of a hotel lobby. The file ROOM. BUB 
relates to an image file of a room off of the hotel lobby. The 
file WELCOME WAV relates to an audio introduction 
related to the LOBBY.BUB file. Here. WELCOME. WAV 
relates to an audio clip welcoming a user into a hotel's lobby. 
Executing the command sequence listed in FIG. 3. the 
monitor 11 will display an image of the hotel lobby which 
is held far three seconds as shown in step 3A. An introduc- 
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tory sound file titled "Welcome'* is then started as shown by 
step 3B. A two second pan of the room from the starting 
point to the right proceeds for 70° degrees as shown in step 
3C. A zoom doubling the image size then occurs 3D over a 

5 span of 4 seconds with a launch of another image then 
occurring as shown in step 3E. The fields specified after the 
ROOM .BUB file indicate where on the new image the 
displayed rectangle should be located. 
Looking specifically at the data fields accompanying each 

10 command, each of the fields PAN. TILT. ZOOM, and TIME 
have specific ranges which relate to the information display 
or played. The combination of fields describe what part of an 
image should be displayed. The PAN field relates to how far 
to the left or right of dead center is the Image portion to be 

15 displayed. The PAN field is measured in terms of degrees 
from -180° to +180° with 0° directly ahead. Directly behind 
the viewer is denoted as -180° or +180° with the positive 
degrees increasing around to the view's right TILT relates 
to the degrees up and down the display should vary from the 

20 mid-line of the image. TILT extends from -90° straight 
down to +90° straight up. ZOOM relates to the degree of 
magnification desired for a given image portion. Here, the 
zoom field of 3A is 1.1. This means that the degree of 
magnification will be 1.1 times as a default magnification. 

25 Finally, the TIME field relates to how much time is allotted 
to go from the previous display to the current display. For 
example, step 3C indicates that the displayed portion should 
pan to 70° to the right with a 10° positive tilt, a zoom of 1. 1 
over a time of 2 seconds. Alternative representations may be 

30 used including Radians, Gradients, and equivalent counting 
systems. 

FIG. 4 shows a display rectangle 41 as it moves across an 
image 40. Image 40 is a virtual representation of the 
dewarped hemispherical image as captured by a wide angle 

35 lens. The progress of the rectangle 41 across the circle 40 of 
FIG. 4 shows a typical sequence as it might be viewed from 
the command file of FIG. 3. The circle 40 represents the 
entire spherical image data set of the lobby with the rect- 
angle 41 showing the presently dewarped and displayed 

40 portion of the image. As steps 3C and 3D are executed, the 
displayed rectangle moves from the coordinates of the image 
plane of rectangle 41 to the coordinates of the image plane 
of rectangle 42 to the coordinates of the image plane of 
rectangle 43. The circle 40 is a virtual image as created in the 

45 memory of computer 10. The numbers 3A through 3D refer 
to the views commanded by the command file. 

However, as dewarping an entire image as shown in FIG. 
4 may tax the memory requirements of the viewer's system, 
only the actually viewed portion needs to be dewarped. This 

50 technique is disclosed in greater detail in U.S. Pat. No. 
5, 185,667. FIG. 5 represents display rectangle 51 on a 
hemispherical image file 50 without the dewarping tech- 
nique applied. The difference is that the display rectangle 51 
still shows signs of spherical distortion contained in the 

55 spherical image. 

FIG. 6 shows a spherical depiction of an image 60 
surrounding a viewing location 62 looking at viewing rect- 
angle 61 as the viewing rectangle moves about under the 
control of the command sequence data file 7 or the viewer. 

60 In order to provide the experience of video through small 
bandwidth coinmunicarions channels {telephone modems), 
many compression techniques have been developed. Even 
the best of these techniques available today suffers from 
poor image quality, small image sizes, and the requirement 

65 of a continuous stream of data from the source to the user. 
The subject invention addresses these issues for a broad 
class of video sequences that deals with looking in different 
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directions from a single vantage point at a static environ- 
ment (an outdoor panorama, the interior of a car, the interior 
of a room, etc.). These environments can be viewed in a 
video presentation from the sequencing of angular and 
magnification commands that guide the presentation as if a 
camera had captured video data at the same location. 

The resulting image sequence is of high quality because 
it begins as a high resolution still. The image size can be 
large or small without effecting the size of the data needed 
to construct the presentation The data can be distributed in 
a batch form as the sequence is created from a still data file 
and its duration is determined by the command sequencing, 
not the bandwidth or storage size available to sustain the 
data stream. One advantage of transmitting the multimedia 
files as a compressed group of files in a batch is that 
continuous linkage between the computer 10 and the com- 
munication network does not need to be maintained. In this 
regard less system resources are used as the files do not need 
to be continuously downloaded. Preferably, while a viewer 
is viewing an image, the computer 10 is decompressing and 
formatting the next image file for display. 

The bandwidth commonly available to distribute digital 
information is presently constrained by twisted pair system 
to approximately 28.8 kbs and will grow with future meth- 
ods using fiber optics, satellite transmission, cable modems, 
etc and related transmission systems. The subject invention 
provides a means and apparatus to address the distribution of 
compelling video experiences fox certain applications via 
networks presently available. 

From the foregoing description, it is or should be readily 
apparent that the described method of operation and appa- 
ratus permits a user to obtain a total immersive guided and 
unguided experience and that the disclosed system achieves 
the objectives sought Of course, the foregoing description is 
that of preferred embodiments of the invention and various 
changes and modifications may be made without departing 
from the spirit and scope of the invention as defined by the 
appended claims. AD of the above-referenced U. S. patents 
and patent applications referenced herein should be deemed 
to be incorporated by reference as to any subject matter 
believed to be essential to an understanding of the present 
invention. 

We claim: 

1. A device for sequencing images from a single still 
image data file providing the perception of video from batch 
data files which comprises: 
a camera image capture system for receiving optical 
images and for producing output corresponding to said 
optical images; 
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a lens attached to said camera imaging system for pro- 
ducing hemispherical optical images, for optical con- 
veyance to said camera imaging system; 

a positioning device that registers both hemispheres so as 
5 to create a set of two hemispheres thereby creating a 
spherical image of a remote environment; 

an image scanning means for receiving said output from 
said camera imaging system and for digitizing said 
output signals from said camera imaging system; 
io a command data file means that sequences said images so 
as to deliver an apparently video experience; 

a data transmission means for sending said image and said 
command data files to personal computers worldwide; 

a personal computer means for executing image transform 
15 processes for processing said data in a sequence con- 
trolled by said command sequencing data or by user 
input moving input image according to selected view- 
ing angles and magnification, and for producing 
sequenced output images; 
M output display means for user viewing of image sequence; 

input means for selecting said viewing angles and mag- 
nification with either mouse, keyboard, or other means 
that controls a hand for navigating the image or a 
magnifying glass for zooming on the image. 

2. The device of claim 1 wherein the environments in the 
image can be distributed via digital networks in a batch 
operation similar to still images, but can be viewed in a 
continuous mode similar to video. 

3. The device of claim 1 wherein the user can take control 
of the image and control the direction of view in any 

30 direction. 

4. The device of claim 1 wherein links to audio, flat 
images, text, graphics, video cups and other spherical pho- 
tographs can be accomplished. 

5. The device of claim 1 wherein the techniques applied 
35 to still images can be applied to video data files as the 

bandwidth available for distribution increases. 

6. The device of claim 1 wherein said input means further 
provides for input of a selected portion and magnification of 
said view to said transform processor means by way of a 

40 simple pointing user interface where motion direction is 
controlled by the direction the hand points in and velocity is 
controlled by the distance from the center of the display. 

7. The device of claim 1 wherein the transform is per- 
formed at rates at or approaching video rates resulting in a 

45 sequenced image presentation that provides the user with the 
perception of video without a continuous update of the input 
data. 

* * » * * 
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